Don't Fear the Bit Flips: Optimized Coding Strategies for Binary Classification

نویسندگان

  • Frederic Sala
  • Shahroze Kabir
  • Guy Van den Broeck
  • Lara Dolecek
چکیده

After being trained, classifiers must often operate on data that has been corrupted by noise. In this paper, we consider the impact of such noise on the features of binary classifiers. Inspired by tools for classifier robustness, we introduce the same classification probability (SCP) to measure the resulting distortion on the classifier outputs. We introduce a low-complexity estimate of the SCP based on quantization and polynomial multiplication. We also study channel coding techniques based on replication errorcorrecting codes. In contrast to the traditional channel coding approach, where error-correction is meant to preserve the data and is agnostic to the application, our schemes specifically aim to maximize the SCP (equivalently minimizing the distortion of the classifier output) for the same redundancy overhead.

برای دانلود متن کامل این مقاله و بیش از 32 میلیون مقاله دیگر ابتدا ثبت نام کنید

ثبت نام

اگر عضو سایت هستید لطفا وارد حساب کاربری خود شوید

منابع مشابه

Relative error due to a single bit-flip in floating-point arithmetic

We consider the error due to a single bit-flip in a floating point number. We assume IEEE 754 double precision arithmetic, which encodes binary floating point numbers in a 64-bit word [1]. We assume that the bit-flip happens randomly so it has equi-probability (1/64) to hit any of the 64 bits. Since we want to mitigate the assumption on our initial floating-point number, we assume that it is un...

متن کامل

Information-Theoretic Multiclass Classification Based on Binary Classifiers - On Coding Matrix Design, Reliability and Maximum Number of Classes

In this paper, we consider the multiclass classification problem based on sets of independent binary classifiers. Each binary classifier represents the output of a quantized projection of training data onto a randomly generated orthonormal basis vector thus producing a binary label. The ensemble of all binary labels forms an analogue of a coding matrix. The properties of such kind of matrices a...

متن کامل

Channel Optimized Quantization of Images over Bursty Channels

| A DCT-based combined source-channel coding system is proposed for transmitting grey-level images over a binary channel with additive Markov noise. It consists of a channel optimized quantization scheme that exploits the channel memory by incorporating the characteristics of the correlated noise in the quantizer design. Experimental results show that this simple system { which employs a xed zo...

متن کامل

Accurate, Non-integer Bit Estimation for H.265/HEVC and H.264/AVC Rate-Distortion Optimization

Lagrangian Rate Distortion Optimization (RDO) is widely employed in modern video encoders such as H.264/AVC and H.264/AVC for mode decision. During the RDO process the distortion and bit rate of each mode has to be estimated and more an accurate estimation leads to better optimized decisions. This paper explores accurate, non-integer bit estimation and its impact on better RDO. Simulations show...

متن کامل

A Low Power and High Performance Ebcot Architecture of Jpeg2000 Encoding

We propose an architecture for Tier-1 of Embedded Block Coding With Optimized Truncation (EBCOT) in the JPEG2000 standard. The architecture is composed of a 16-bit parallel context generator and a 3-stage pipelined binary arithmetic encoder. The former is designed for low power consumption. The later is used to achieve an high throughput. The design is verified on an AMBA-based system as an acc...

متن کامل

ذخیره در منابع من


  با ذخیره ی این منبع در منابع من، دسترسی به آن را برای استفاده های بعدی آسان تر کنید

برای دانلود متن کامل این مقاله و بیش از 32 میلیون مقاله دیگر ابتدا ثبت نام کنید

ثبت نام

اگر عضو سایت هستید لطفا وارد حساب کاربری خود شوید

عنوان ژورنال:
  • CoRR

دوره abs/1703.02641  شماره 

صفحات  -

تاریخ انتشار 2017